Team, Visitors, External Collaborators
Overall Objectives
Research Program
Application Domains
Highlights of the Year
New Software and Platforms
New Results
Bilateral Contracts and Grants with Industry
Partnerships and Cooperations
Dissemination
Bibliography
XML PDF e-pub
PDF e-Pub


Section: New Results

From Attribute-labels to Faces: Face Generation using a Conditional Generative Adversarial Network [53], [54]

Participants : Yaohui Wang, Antitza Dantcheva, Francois Brémond.

Keywords: Generative Adversarial Networks, Face generation

Facial attributes are instrumental in semantically characterizing faces. Automated classification of such attributes (i.e., age, gender, ethnicity) has been a well studied topic. We here seek to explore the inverse problem, namely given attribute-labels the generation of attribute-associated faces. The interest in this topic is fueled by related applications in law enforcement and entertainment. In this work, we propose two models for attribute-label based facial image and video generation incorporating 2D (see Figure 10) and 3D (see Figure 11) deep conditional generative adversarial networks (DCGAN). The attribute-labels serve as a tool to determine the specific representations of generated images and videos. While these are early results (see Figure 12 and 13), our findings indicate the methods' ability to generate realistic faces from attribute labels.

Figure 10. Architecture of proposed 2D method consisting of two modules, a discriminator D and a generator G. While D learns to distinguish between real and fake images, classifying based on attribute-labels, G accepts as input both, noise and attribute-labels in order to generate realistic face images.
IMG/2dmodel.png
Figure 11. Architecture of proposed 3D model for face video generation
IMG/3dmodel.png
Figure 12. Example images generated by the proposed 2D model.
IMG/img2.png
(a) no glasses, female, black hair, smiling, young
IMG/img3.png
(b) glasses, female, black hair, not smiling, old
IMG/img5.png
(c) no glasses, male, no black hair, smiling, young
IMG/img8.png
(d) glasses, male, no black hair, not smiling, old
Figure 13. Chosen output samples from 3DGAN
IMG/3ddemo1.png
(a) male, adolescent
IMG/3ddemo2.png
(b) male, adult
IMG/3ddemo3.png
(c) female, adolescent
IMG/3ddemo4.png
(d) male, adult